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REMARKS 

The present response is intended to be fully responsive to all points of objection 
and/or rejection raised by the Office Action and is believed to place the application in 
condition for allowance. Favorable reconsideration and allowance of the application is 
respectfully requested. 

Drawings 

The Office Action has objected to the drawings. It is respectfully submitted that the 
attached substitute drawing sheets overcome the Office Action objections. 

Specifically, the Office Action objected to Figures 1A and IB because they should 
include a designated legend such as "Prior Art". Figures 1 A and IB have been amended and 
they now include the requisite legend "Prior Art". 

Further, the Office Action has objected to Figure 2, contending that item 24 should be 
labeled "buffer memory", item 25 should be labeled "Branch Metric Calculation Unit", 
reference numbers 34 and 36 need to be rearranged, there is no linkage between controller 32 
and decoder 20, item 30 should be labeled "log likelihood ratio unit", and items 36 and 38 
should be labeled "short term" and "long term", respectively. As indicated in red ink on the 
attached substitute sheets, Figure-2 has been amended to include the above labels as stated in 
the specification. The reference numbers 34 and 36 have been rearranged and a connection 
line has been added to link controller 32 to decoder 20. 

Further, the Office Action has objected to the Figures 3A and 3B, contending that 
they should be combined into one drawing, namely, Figure 3. As indicated in red ink on the 
attached substitute sheets, Applicant has amended Figures 3 A and 3B to be combined into 
one Figure, namely FIG. 3, as suggested by the Office Action. 

Applicant respectfully submit that the amendments to the drawings overcome the 
Office Action's objections and do not add any new matter to the application. 

A complete set of formal drawings, incorporating the amendments herein, is being 
submitted concurrently with this Amendment. 
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Specification 

The Office Action has objected to the Title of the Invention contending that the Title 
is not descriptive. A new title has been submitted. It is respectfully submitted that the new 
title is properly descriptive of the subject matter of this application. 

The Office Action objected to the Abstract contending that the term "wherein" should 
be inserted at line 1 between the two words "..symbols, the..". The abstract has been 
amended to include the word "wherein" between the two words, as requested by the Office 
Action. In view of this amendment, Applicant respectfully requests that the objection to the 
Abstract be withdrawn. 

Additionally, the Office Action objected to various informalities in the specification. 
It is respectfully submitted that all the informalities pointed out by the Office Action have 
been removed by the present amendment of the specification, as shown by the marked-up 
copy of the substitute specification submitted herewith. In view of this amendment, Applicant 
respectfully requests that the Office Action withdraw the objections to the specification. 

Specifically, Applicant has corrected and/or addressed the following informalities 
pointed out by the Office Action: 

- The term "pre-calculating" should be replaced with "calculating". It is respectfully 
submitted the term "pre-calculating" has been replaced with the term "calculating" only in the 
Abstract. 

-. The Office Action objected the use of "further alternatively or additionally" 
contending that this should be limited to only one transitional phrase. Applicant respectfully 
traverse this objection. Although many instances of the phrase "further alternatively" have 
been removed from the specification, it is respectfully submitted that certain aspect of the 
invention may be implemented as either in additional or an alternative feature. 

- In page 5, line 6 the sentence starts with "There is therefore. . . " has been reworded as 
"Therefore there is ... " 

- It is respectfully submitted that the term "preferably" has been removed in some 
appropriate places throughout the specification. 
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- The Office Action indicated that "All reference numbers throughout the 
specification should be in parenthesis". It is respectfully submitted that throughout the 
specification the term "block" has been added to reference number in parenthesis. 

It is respectfully submitted that the specification has been reviewed to the extent 
necessary to determine the presence of minor errors. Minor errors have been corrected. 

A substitute specification is being filed herewith under 37 CFR 1.125(b) as well as a 
marked-up copy showing the amendments made via the substitute specification relative to the 
specification as originally filed.. The substitute specification contains no new matter. 

Status of Claims 

Claims 1, 3 - 9, 11, 15' - 19, 21 - 27, 29 - 31, 33, and 43 - 49 are pending in the 
application. Claims 2, 10, 12, 20, 28, 32, 34-42 have been canceled without prejudice to their 
reentry at a later stage or in a related application. Claims 1, 3 - 9, 1 1, 15 - 19, 21 - 27, 29 - 
31, 33, and 43 - 49 have been amended. Applicant respectfully assert that the amendments to 
the claims do not add any new matter to the application. 

35 U.S.C. 112 Rejections 

The Office Action rejected claims 1-34, 37-38, 40, and 42-49 as being allegedly 
indefinite for failing to particularly point out and distinctly claim the subject matter which the 
applicant regards as the invention. Claims 1, 3, 4, 6 and 15 have been amendment to remove 
any potentially indefinite language and, thereby, to overcome the above rejections. Claims 2, 
10, 12, 20, 28, 32 and 34-42 have been canceled and, therefore, the Office Action rejection of 
these claims are now moot. . As to an alleged lack of antecedent basis in some of the claims, 
Applicant respectfully submits that each claim has been revisited and all instances of 
potential lack of antecedent basis have been addressed. Furthermore, Applicant respectfully 
submits that the claims have been amended to make the claim language clear and concise. 
Applicant respectfully assert that claims 1, 3 -9, 11, 15-19, 21-27, 29-31, 33, and 42-49, as 
amended, are proper under 35 USC 112 and request that the indefiniteness rejections be 
withdrawn. 
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The Office Action rejected claims 1 - 49 under 35 U.S.C. 103(a) as being 
unpatentable over Lerzar (USPN 6343368 Bl, referred to as Lerzar) in view of Viterbi et al. 
(USPN 5933462, referred to as Viterbi). 

Applicant believes that this rejection should be withdrwan in view of the above 
amendments and the following remarks. 

As is well established, an obviousness rejection requires a teaching or a suggestion by 
the relied upon prior art of all the elements of a claim (MPEP 2142). 

Applicant respectfully assert that neither Lerzar nor Viterbi, alone or in combination, 
teach or suggest the limitations of claims 1, 3 - 9, 11, 15-19, 21-27, 29-31, 33, and 42-49, as 
amended. 

Specifically, neither Lerzar nor Viterbi, alone or in combination, teach or suggest "re- 
calculating at least some of the state metric vectors based on the stored reference vector", as 
recited in amended claim 1 . 

Accordingly, Applicant respectfully assert that a prima facie case of obviousness over 
claim 1 cannot be established, and Applicant respectfully request that the rejection be 
withdrawn. 

Claims 3-9, 11 and 13 - 22 are dependent from claim 1 and, therefore, it is 
respectfully submitted that these claims are patentable at least for the reason given above. 
Accordingly, Applicant respectfully requests that the rejection of amended claims 3-9, 11 
and 13-22 also be withdrawn. 

Claim 23, as amended, recites, inter alia, "calculating a plurality of state metric 
vectors from a block of symbols in a first direction; storing a reference vector of the 
calculated state metric vectors; and calculating the state metric vectors from a block of 
symbols in a second direction based on the stored reference vector". 

Applicant respectfully asserts that neither Lerzar nor Viterbi, alone or in combination, 
teach or suggest at least "calculating the state metric vectors from a block of symbols in a 
second direction based on the stored reference vector", as recited in amended claim 23. 

Accordingly, Applicant respectfully submits that a prima facie case of obviousness 
over claim 23 cannot be established, and Applicant respectfully request that the rejection of 
claim 23 be withdrawn. 
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Since claims 24 - 27, 29 - 31 and 33 are dependent from claim 23, Applicant believes 
the rejection of these claims is overcome at least for the reasons given above. Accordingly, it 
is respectfully requested that the rejection of claims 24-27, 29-31 and 33 be withdrawn. 
Claim 43, as amended, recites, inter alia, "circuitry to calculate state metric vectors from a 
block of symbols in a predetermined direction and a memory having a long term storage area 
to store a reference vector of the calculated state metric vectors and a short term storage to 
store at least some of the re-calculated state metric vectors which are re-calculated from the 
block of symbols in the predetermined direction based on the stored reference vector". 

Applicant respectfully submit that neither Lerzar nor Viterbi, alone or in combination, 
teach or suggest "a memory having a long term storage area to store a reference vector of the 
calculated state metric vectors and a short term storage to store at least some of the re- 
calculated state metric vectors which are re-calculated from the block of symbols in the 
predetermined direction based on the stored reference vector" as recited in amended claim 43. 

Accordingly, Applicant respectfully assert that a prima facie case of obviousness over 
claim 43 cannot be established, and Applicant respectfully request that the rejection of claim 
43 be withdrawn. 

Since claims 44 - 49 are dependent from claim 43, Applicant believes the rejection of 
these claims has been overcome for at least the same reason, and Applicant respectfully 
requests that the rejection be withdrawn. 

In view of the foregoing amendments and remarks, the pending claims of the above- 
identified application are deemed to be allowable. Favorable reconsideration and allowance 
of the application are respectfully requested. 
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Should the Examiner have any question or comment as to the form, content or entry 
of this Amendment, the Examiner is requested to contact the undersigned at the telephone 
number below. Similarly, if there are any further issues yet to be resolved to advance the 
prosecution of this application to issue, the Examiner is requested to telephone the 
undersigned counsel. 

Please charge any fees associated with this paper to deposit account No. 05-0649. 



Dated: January 23, 2003 



Eitan, Pearl, Latzer & Cohen-Zedek 

One Crystal Park, Suite 210, 2011 Crystal Drive 

Arlington, VA, USA 22202-3709 

Telephone: (703) 486-0600 

Fax: (703) 486-0800 



Respectfully submitted, 




Caleb^Ptmack \y 
Attorney for Applicant(s) 
Registration No. 37,912 
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VERSION WITH MARKINGS TO SHOW CHANGES MADE 

In the Drawings, the following changes were made: 

Figs. 1 A, IB, 2 and 3 were amended as indicated in red ink. 

In the title the following changes were made: 

[BAHL DECODING! APPARATUS AND METHOD OF STORING REFERENCE 
VECTOR OF STATE METRIC 

In the Abstract the following changes were made: 

A method of calculating recursive state metric vectors of a block of symbols wherein , 
the state metric vectors being supplied to an output calculating unit. The method includes 
[pre-] calculating the state metric vectors from a first side of the block, and calculating for a 
second time at least some of the state metric vectors from the first side of the block. 



In the specification, a version of a substitute specification under 37 CFR 1.125(b) 
with markings to show changes made is being submitted herewith. It is respectfully asserted 
that no new matter has been added to the specification. 

In the claims, the following changes were made: 

1. (Once Amended) A method [of calculating recursive state metric vectors of a block of 
symbols, the state metric vectors being supplied to an output calculating unit,] comprising: 

storing a reference vector of [pre-calculating the] a state metric comprising a plurality 
of vectors calculated, [from] in a predetermined [side] direction, [of the] from a block of 
symbols ; and 

re-calculating [for a second time] at least some of the state metric vectors [from the of 
the block of symbols] based on the stored reference vector . 
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3. (Once Amended) A method according to claim 1, {comprising] wherein storing 
comprises storing [ fewer than all the pre-calculated] two or more reference vectors. 

4. (Once Amended) A method according to claim [3] L wherein re-calculating [for a 
second time] at least some of the state metric vectors comprises calculating [those] state 
metric vectors which were not stored as reference vectors . 

5. (Once Amended) A method according to claim [4] 3 a wherein storing [fewer than all 
the pre-calculated] two or more reference vectors comprises storing a number of reference 
vectors which is about the square root of the number of [pre-calculated] the calculated state 
metric vectors. 

6. (Once Amended) A method according to claim 3, wherein storing [fewer than all the 
pre-calculated] two or more reference vectors comprises storing vectors selected responsive 
to [the] locations of singular functions used in the [pre-]calculating of the calculated state 
metric . 

7. (Once Amended) A method according to claim 3, wherein storing [fewer than all the 
pre-calculated] two or more reference vectors comprises storing vectors selected in. 
predetermined intervals. 

8. (Once Amended) A method according to claim 7, wherein storing two or more 
reference vectors selected in predetermined intervals comprises storing reference vectors with 
equal intervals between them. 

9. (Once Amended) A method according to claim 7, wherein storing two or more 
reference vectors selected in predetermined intervals comprises storing reference vectors with 
intervals of decreasing size between them. 

11. (Once Amended) A method according to claim [3] 1, wherein re-calculating [for a 
second time the] at least some of the state metric vectors comprises calculating at least some 
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[of the at least some] of the state metric v ectors using a reverse function of a function used in 
the [pre-] calculating the reference vector of the state metric . 

15. (Once Amended) A method according to claim [13] i, wherein re-calculating [for the 
second time] comprises calculating at least some of the vectors using [the] a function which 
was used in the [pre-] calculation of the reference vector of the state metric . 

16. (Once Amended) A method according to claim 1, further comprising: 

[wherein the pre-l calculating the state metric by [is performed] using 
a function which is an approximation of an original function; and 

re-calculating [for a second time] the at least some of the state metric 
vectors [comprises calculating at least some of the at least some of the 
vectors] by using a reverse function of the original function. 

17. (Once Amended) A method according to claim 1, wherein storing the reference vector 
further comprises [the pre-]calculating [is performed] the state metric vectors from the block 
of symbols in the predetermined direction by using a function which is an approximation of 
an original function when the original function is non-reversible. 

18. (Once Amended) A method according to claim [1] 17, wherein [pre-]calculating the 
state metric vectors from [a first side of] the block of symbols in the predetermined direction 
comprises forward calculating [forward] of the state metric vectors. 

19. (Once Amended) A method according to claim [1] 17, wherein [pre-]calculating the 
state metric vectors from [a first side of] the block of symbols in the predetermined direction 
comprises backward calculating [backward] of state metric vectors. 

21. (Once Amended) A method according to claim [1] 16, wherein [pre-]calculating the 
state metric [vectors] comprises [pre-]calculating a number of vectors substantially equal to 
[of the] a size of an encoding block. 
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22. (Once Amended) A method according to claim [1] 16, wherein [pre-]calculating the 
state metric [vectors] comprises [pre-]calculating a number of vectors substantially smaller 
than [the] a size of an encoding block. 

23. (Once Amended) A method [of calculating recursive state metric vectors from 
opposite sides of a block of symbols, the state metric vectors being supplied to an output 
calculating unit,] comprising: 

[pre-] calculating a plurality of state metric vectors from a block of symbols in a first 
[side] direction [of the block]; 

storing [fewer than all] a reference vector of the [pre-]calculated state metric vectors; 

and 

calculating the state metric vectors from a block of symbols in a second [side] 
direction [of the block] based on the stored reference vector, [after pre-calculating the 
plurality of state metric vectors from the first side of the block.] 

24. (Once Amended) A method according to claim 23, comprising recalculating [at least 
one of the] a first state metric vector[s] from the block of symbols in the first [side] direction 
[of the block for a second time] after calculating [at least one of the] a second state metric 
vector[s] from the block of symbols in the second [side] direction [of the block of]. 

25. (Once Amended) A method according to claim 24, wherein re-calculating [at least 
one of] the first state metric vector[s] from the block of symbols in the first [side] direction 
[of the block for a second time] comprises calculating the [at least one of the] first state 
metric vectors [from] based on the stored reference vectorfs], 

26. (Once Amended) A method according to claim [25] 23, wherein storing [fewer than 
all the pre-calculated] the reference vector[s] comprises storing two or more reference vectors 
calculated in predetermined intervals. 
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27. (Once Amended) A method according to claim 24, wherein calculating the first [at 
least one of the] state metric vector[s] comprises calculating the first state metric vector based 
on a closest stored reference vector. 

29. (Once Amended) A method according to claim 23, further comprising: 

storing two or more reference vectors; 

dividing [w herein] the block of symbols [is divided] into a [plurality 
of] two or more segments defined by the stored reference vectors^ and 

[ comprising] re-calculating for [substantially all] the two or more 
segments [at least one of] the first state metric vector[s for a second time] 
based on [the] a respective stored reference vector[s] of the segment. 

30. (Once Amended) A method according to claim 29, wherein re-calculating for 
[substantially all] the two or more segments comprises re-calculating state metrics for [all] 
some of the two or more segments[ except the first segment]. 

31. (Once Amended) A method according to claim 29, comprising storing [the at least 
one of the vectors which was calculated for the second time] a re-calculated reference vector 
of the re-calculated state metric . 

33. (Once Amended) A method according to claim [32] 3_L comprising storing 
[substantially all] the vectors of the re-calculated state metrics of the segment, [which were 
calculated for the second time.] 

43. (Once Amended) An apparatus [A state metric calculation unit,] comprising: 

circuitry [for recursively] to calculating] state metric vectors from a block of 

symbols in a [first side] predetermined direction [of a block including a predetermined 

number of symbol groups]; and 

a memory having a long term storage area [for] to storefing] a reference vector of the 

calculated state metric vectors and a short term storage to store at least some of the re- 
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calculated state metric vectors which are re-calculated from the block of symbols in the 
predetermined direction based on the stored reference vector . 

_[which has a maximal storage space for state metric vectors substantially smaller than that 
required to store the predetermined number of state metric vectors]. 

44. (Once Amended) [A calculation unit according to] The apparatus of claim 43, wherein 
[the] a maximal storage space of the memory [has room for] is capable to store[ing] less than 
fifty percent of [the] a predetermined number of the state metric vectors. 

45. (Once Amended) [A calculation unit according tol The apparatus of claim 43, wherein 
the maximal storage space of the memory [has room for] is capable to store[ing] less than 
twenty percent of the predetermined number of state metric vectors. 

46. (Once Amended) [A calculation unit according to] The apparatus of claim 43, wherein 
the circuitry implements a plurality of different functions for calculating the state metric 
vectors. 

47. (Once Amended) [A calculation unit according to] The apparatus of claim 46, wherein 
the circuitry implements a pair of functions for calculating the state metric vectors which pair 
comprise mutual reverse functions. 

48. (Once Amended) [A calculation unit according to] The apparatus of claim 43, wherein 
[the memory comprises a] the long term storage area [for storing] is used to store two or more 
[pre-calculated state metric] reference vectors in predetermined intervals and [a] the short 
term storage area [for storing] is used to store the calculated state metric vectors between two 
reference vectors. 

49. (Once Amended) [A calculation unit according to] The apparatus of claim 48, wherein 
the long term storage area serves for storing also state metric vectors from between two 
reference vectors. 
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CHANGES MADE 



[BAHL DECODING 1 APPARATUS AND METHOD OF STORING 
REFERENCE VECTOR OF STATE METRIC 



FIELD OF THE INVENTION 

[0001] The present invention relates to decoding and in particular to methods 

for implementing Bahl decoding. 

BACKGROUND OF THE INVENTION 
[0002] Messages transmitted over a wireless medium are encoded in order to reduce 
the chances that noise will corrupt the message. The encoding translates an original 
block of an original message which comprises a plurality of bits which are either '0' or 
T to an encoded block which is formed of a plurality of symbols which are either '0' 
or T. The encoding of the block usually includes adding redundancy (i.e., making the 
encoded block longer than the original block), introducing symbol dependency (i.e., 
making the value of each symbol in the encoded block a function of a plurality of bits 
in the original block) and interleaving the block (i.e., mixing the order of the symbols 
in the encoded block). In modern codes the size of the original block is usually very 
large, of the order of hundreds, thousands or tens of thousands of bits. Thus, the 
encoding turns a block of binary bits into a block of binary symbols. It is noted that 
there is not necessarily a direct correlation between the value of a single bit and the 
value of any one of the encoded symbols. However, the number of bits in the original 
block and the number of symbol groups in the encoded block are generally the same. 
Generally in convolutional codes, bits and symbol groups in corresponding locations 
within the block are related in that they form pairs of input and output of encoders and 
decoders, as described hereinbelow. 

[0003] In convolutional codes, an encoder which has a fixed number of possible 
states is used to encode the original block. Each bit of the original block which enters 
the encoder changes a current state of the encoder to a next state according to the 
value of the entering bit. It is noted that for convolutional codes, from each state the 
encoder can move only to two other states based on whether the input is '0' or T. For 
each entering bit the encoder generates a group of one or more symbols forming the 
transmitted message. In other trellis codes, larger inputs are received by the encoder 
in each iteration, and the number of possible state changes are larger accordingly. In 
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decoding, the decoder assigns each state a state metric (SM), which represents the 
conditional probability that the encoder was in that state. 

[0004] During transmission of the message, noise is added to the transmitted encoded 
message, and a decoder is used to extract the original message from the received 
message, which includes the noise. Normally, each symbol in the received message is 
represented in the receiver, before decoding, by a word which represents the chance 
that the symbol is a logical T. A high positive value of the word means that the 
symbol is a logical T with high confidence, while a negative value with a high 
absolute value means the symbol is a logical '0' with high confidence. A word with a 
zero value means that the symbol is a '0' or T with equal probability. This 
representation is referred to herein as soft data. 

[0005] Some decoding methods include one or more iterations of a step of an A- 
Posteriori probability estimation in which the soft data representation of each symbol 
is adjusted and/or represented by a hard value (i.e., either '0' or T) based on the values 
of other symbols in the block of the adjusted symbol. 

[0006] Many methods for performing the adjustment step are based on the Bahl 
algorithm which is described, for example, in Steven S. Pietrobon, "Implementation 
and Performance of a Turbo/MAP Decoder", Int. J. Satellite Commun., vol. 16, pp. 
23-46, Jan.-Feb. 1998, the disclosure of which is incorporated herein by reference. In 
the Bahl algorithm, for each received symbol group, two vectors of state metrics are 
prepared: a forward vector which represents the conditional probability of the encoder 
being in each of the possible states immediately before the symbol group was 
generated and a backward vector which represents the conditional probability of the 
encoder being in each of the possible states immediately after the symbol group was 
generated. The forward vector is calculated based on the received symbols which 
precede the adjusted symbol group in the block and the backward vector is calculated 
based on the received symbols which follow the adjusted symbol group in the block. 
The forward and backward vectors are recursively dependent on the previous state 
metric vector in the respective directions from the end points of the block. 
[0007] The forward and backward vectors of each symbol group are supplied 
concurrently to a log likelihood ratio (LLR) unit which provides an adjusted output 
value of the symbol group based on the forward and backward vectors and the 
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original value of the symbol group. The output value is chosen according to the most 
likely transitions between the state metrics of the forward and backward vectors. 
[0008] After the vectors are supplied to the LLR unit, the vectors may be discarded 
unless they are needed for calculating vectors of other symbol groups. Therefore, it is 
preferred, in order to save storage, that the vectors be calculated immediately before 
they are used. However, due to the recursive nature of the vectors which are 
calculated from opposite sides of the block, such immediate calculation, usage and 
discarding is performed in the prior art only in one direction, e.g., in the forward 
direction. 

[0009] A conventional prior art method for calculating the output values of all the 
symbols in a block comprises two passes over the block. In a first pass over the block, 
performed before the LLR unit begins the adjusting, the backward recursion vectors 
for all the symbols in the block are calculated and stored. In a second pass over the 
block, beginning from the opposite end of the block, the forward recursion vectors are 
calculated, the respective backward recursion vectors are retrieved from the storage 
and the forward and backward vectors are supplied to the LLR unit. The supplied 
vectors are immediately used by the LLR unit and then they are discarded. 
[0010] The storage requirements in this method, required in order to store the 
backward recursion vectors, are quite large. In order to reduce the required storage 
space, it has been suggested to perform the symbol adjustments in sub-blocks in 
which each symbol is influenced only by the symbols in its sub-block, rather than by 
all the symbols in the block. Such method is described, for example, in PGT 
publication WO98/20617 the disclosure of which is incorporated herein by reference. 
The WO98/20617 publication shows that by beginning the recursion calculations 
from a point sufficiently before the beginning of the sub-block, the recursion values 
corresponding to the symbols in the sub-block are sufficiently valid although the 
recursion did not start from the beginning of the block. Even so, the storage 
requirements for a 16-state code, using 10-bit state metrics for blocks of 40 symbols, 
is 6400 bits. When implementing a hardware decoder such an amount of storage is 
very expensive. 

[001 1] Fig. 1A is an exemplary trellis map 10 of the convolutional code 7.5 which is 
known in the art. The encoder of the 7.5 code may be in any of four states s(n) 12 
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identified by a combination of two bits. From each of the states s(n), the encoder can 
move to one of two other states s(n+l) based on an input bit d(n), as indicated by 
branches 14. In moving from state s(n) to state s(n+l) 16, the encoder provides a 
symbol group formed of a pair of bits cg(n) and Cj(n). The symbol group co(n) and 

ci(n) is transmitted to a receiver which uses a decoder to determine the original bits 
d(n). The decoder assigns each received symbol group with a vector of branch metric 
(BM) values 5 n (co,cj) which designate the conditional probability that the received 

symbol group originates from the transmitted symbol group designating cq and cj. In 

addition, the decoder calculates forward (a n ) and backward ((3 n ) state metric vectors 

which have elements for each of the states s(n) which designate the conditional 
probability that the decoder was in the state s(n) at time n. Generally, forward vectors 
a n are recursively dependent on preceding vectors (a n -i-i = f(a n , 5 n )), and backward 

vectors (3 n are recursively dependent on following vectors (P n = f(P n +i , 5 n )). 

[0012] As can be seen in Fig. 1A, Each pair of states s(n) is connected to a pair of 
states s(n+l) although not necessarily the same states. The pairs of states with the 
connecting branches form a butterfly trellis which is depicted in Fig. IB which is a 
butterfly trellis diagram for convolutional codes. This feature of pairs of states is 
generally true in trellises of convolutional codes. In Fig. 1 A states 00 and 01 (which 
are equivalent to states X and Y in fig. IB) at time n are connected to states 00 and 10 
(which are equivalent to states Z and W in fig. IB) at time n+1. Similarly, states 10 
and 1 1 at time n (which are equivalent to states X and Y in fig. IB) are connected to 
states 01 and 1 1 at time n+1 (equivalent to states Z and W in fig. IB). 

SUMMARY OF THE INVENTION 
[0013] An aspect of some preferred embodiments of the invention relates to reducing 
the amount of memory required for decoding convolutional codes. 
[0014] An aspect of some preferred embodiments of the present invention relates to a 
method of providing pairs of forward and backward vectors concurrently to an LLR 
unit for A-Posteriori probability estimation of a decoded block. During a first stage, 
before the beginning of the operation of the LLR unit, substantially all of the 
backward vectors are calculated but only one or more reference vectors, from which 
the rest of the vectors may be easily re-calculated, are stored. During a second stage, 
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the backward vectors which were not stored are calculated from the stored reference 
vectors and are supplied to the LLR unit along with the forward vectors. 
[0015] In a preferred embodiment of the present invention, during the first stage, 
reference vectors are stored at predetermined intervals. In the second stage the 
reference vectors are retrieved in course from the storage and are used to re-calculate 
a group of non- stored vectors between a current and a previous reference vector. 
[Preferably,] A short term storage area is used to store the re-calculated vectors. Each 
group of non-stored vectors are preferably stored in place of the previously re- 
calculated vectors, as the previously re-calculated vectors were used already and are 
not needed any more. 

[0016] An aspect of some preferred embodiments of the present invention relates to 
using a reverse function in recalculating at least some of the vectors. In some 
preferred embodiments of the invention in which the backward vectors are calculated 
in the first stage using a reversible function, the backward vectors are calculated in the 
second stage using the reverse function of the function of the first stage. Thus, both 
the backward and forward vectors are calculated in the same direction of progression 
over the block during the second stage. In a preferred embodiment, the vectors 
calculated in the first stage are not stored. Alternatively, a plurality of backward 
vectors from the first stage are stored, in order to limit possible round off errors due to 
the use of the reverse function and/or when singular functions are encountered. 
Further alternatively or additionally, the reverse function is used to re-calculate only 
some of the non-stored vectors and the rest of the recalculated vectors are calculated 
using the non-reversed function. 

[0017] [There is therefore] Therefore there is provided in accordance with a preferred 
embodiment of the present invention, a method of calculating recursive state metric 
vectors of a block of symbols, the state metric vectors being supplied to an output 
calculating unit, including pre-calculating the state metric vectors from a first side of 
the block, and calculating for a second time at least some of the state metric vectors 
from the first side of the block. 

[0018] Preferably, pre-calculating the state metric vectors includes pre-calculating the 
state metric vectors before supplying substantially any of the vectors to the output 
calculating unit. 
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[0019] Preferably, the method includes storing fewer than all the pre-calculated 
vectors. 

[0020] Preferably, calculating for a second time at least some of the state metric 
vectors includes calculating those vectors which were not stored. 
[0021] Preferably, storing fewer than all the pre-calculated vectors includes storing a 
number of vectors which is about the square root of the number of pre-calculated 
vectors. Preferably, storing fewer than all the pre-calculated vectors includes storing 
vectors selected responsive to the locations of singular functions used in the pre- 
calculating of the vectors. Alternatively or additionally, storing fewer than all the pre- 
calculated vectors includes storing vectors selected in predetermined intervals. 
Preferably, storing vectors selected in predetermined intervals includes storing vectors 
with equal intervals between them. Alternatively, storing vectors selected in 
predetermined intervals includes storing vectors with intervals of decreasing size 
between them. 

[0022] Preferably, calculating for a second time the at least some of the state metric 
vectors includes calculating the vectors based on the stored vectors. 
[0023] Preferably, calculating for a second time the at least some of the state metric 
vectors includes calculating at least some of the at least some of the vectors using a 
reverse function of a function used in the pre-calculating. Preferably, substantially 
none of the pre-calculated vectors are stored during the pre-calculation. Alternatively, 
substantially only pre-calculated vectors from which a next pre-calculated vector is 
calculated using a non-reversible function, are stored during the pre-calculation. 
[0024] Preferably, calculating for the second time includes calculating at least some 
of the vectors using the function which was used in the pre-calculation. Alternatively 
or additionally, the pre-calculating is performed using a function which is an 
approximation of an original function and calculating for a second time the at least 
some of the state metric vectors includes calculating at least some of the at least some 
of the vectors using a reverse function of the original function. Further alternatively or 
additionally, the pre-calculating is performed using a function which is an 
approximation of an original function when the original function is non-reversible. 
[0025] Preferably, pre-calculating the state metric vectors from a first side of the 
block includes calculating forward state metric vectors. Alternatively, pre-calculating 
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the state metric vectors from a first side of the block includes calculating backward 
state metric vectors. Preferably, the method includes calculating state metric vectors 
from a second side of the block after the pre-calculating. 

[0026] Preferably, pre-calculating the state metric vectors includes pre-calculating a 
number of vectors substantially of the size of an encoding block. Alternatively or 
additionally, pre-calculating the state metric vectors includes pre-calculating a number 
of vectors substantially smaller than the size of an encoding block. 
[0027] There is further provided in accordance with a preferred embodiment of the 
present invention, a method of calculating recursive state metric vectors from opposite 
sides of a block of symbols, the state metric vectors being supplied to an output 
calculating unit, including pre-calculating a plurality of state metric vectors from a 
first side of the block, storing fewer than all the pre-calculated state metric vectors, 
and calculating state metric vectors from a second side of the block after pre- 
calculating the plurality of state metric vectors from the first side of the block. 
Preferably, the method includes calculating at least one of the state metric vectors 
from the first side of the block for a second time after calculating at least one of the 
state metric vectors from the second side of the block. Preferably, calculating at least 
one of the state metric vectors from the first side of the block includes calculating the 
state metric vectors from the stored vectors. Preferably, storing fewer than all the pre- 
calculated vectors includes storing vectors calculated in predetermined intervals. 
Preferably, calculating the at least one of the state metric vectors includes calculating 
based on the closest stored vector. 

[0028] Preferably, the method includes presenting an output calculating unit with 
pairs of corresponding state metric vectors from opposite sides of the block. 
Preferably, the block of symbols is divided into a plurality of segments defined by the 
stored vectors and the method includes calculating for substantially all the segments at 
least one of the vectors for a second time based on the respective stored vectors of the 
segment. Preferably, calculating for substantially all the segments includes calculating 
for all the segments except the first segment. Preferably, the method includes storing 
the at least one of the vectors which was calculated for the second time. Preferably, 
calculating the at least one of the vectors for the second time includes calculating 
substantially all the non-stored vectors of the segment. Preferably, the method 
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includes storing substantially all the vectors of the segment which were calculated for 
the second time. Preferably, the method includes calculating at least one of the vectors 
from the first side of the block for at least a third time. 

[0029] There is further provided in accordance with a preferred embodiment of the 
present invention, a method of calculating recursive state metric vectors of a block of 
symbols, the state metric vectors being supplied to an output calculating unit, 
including calculating a plurality of state metric vectors representing a first side of the 
block using a first function, and calculating a plurality of state metric vectors 
representing the first side of the block using a second function different from the first 
function. 

[0030] Preferably, the first function is identical to a third function when the 

third function is reversible and is received by adding a small value to the third 
function when the third function is non-reversible. Preferably, the second function is 
substantially a reverse of the first function. 

[0031] Alternatively, the first function includes an approximation of a third function 
and the second function includes a substantial reverse of the third function. 
[0032] Preferably, the first function includes a log MAP function. 
[0033] Preferably, calculating the plurality of vectors using the first function includes 
calculating substantially all the vectors representing the first side of the block. 
[0034] There is further provided in accordance with a preferred embodiment of the 
present invention, a method of calculating recursive state metric vectors of a block of 
symbols, the state metric vectors being supplied to an output calculating unit, 
including calculating a plurality of state metric vectors representing a first side of the 
block recursively based on immediately preceding vectors in the block, and 
calculating a plurality of state metric vectors representing a second side of the block 
based on immediately preceding vectors in the block. 

[0035] Preferably, calculating the plurality of vectors representing the first and 
second sides of the block includes calculating pairs of vectors representing first and 
second sides of the block, substantially concurrently. 

[0036] There is further provided in accordance with a preferred embodiment of the 
present invention, a state metric calculation unit, including circuitry for recursively 
calculating state metric vectors from a first side of a block including a predetermined 
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number of symbol groups, and a memory for storing state metric vectors which has a 
maximal storage space for state metric vectors substantially smaller than that required 
to store the predetermined number of state metric vectors. 

[0037] Preferably, the maximal storage space of the memory has room for storing less 
than fifty percent of the predetermined number of state metric vectors. Further 
preferably, the maximal storage space of the memory has room for storing less than 
twenty percent of the predetermined number of state metric vectors. 
[0038] Preferably, the circuitry implements a plurality of different functions for 
calculating the state metric vectors. Preferably, the circuitry implements a pair of 
functions for calculating the state metric vectors which pair include mutual reverse 
functions. 

[0039] Preferably, the memory includes a long term storage area for storing pre- 
calculated state metric reference vectors in predetermined intervals and a short term 
storage area for storing state metric vectors between two reference vectors. 
Preferably, the long term storage area serves for storing also state metric vectors from 
between two reference vectors. 

BRIEF DESCRIPTION OF FIGURES 
[0040] The invention will be more clearly understood by reference to the 

following description of preferred embodiments thereof in conjunction with the 
figures, in which same number designations are maintained throughout the figures for 
each element and in which: 

[0041] Fig. 1A is an exemplary trellis map of the convolutional code 7.5 which is 
known in the art; 

[0042] Fig. IB is a butterfly trellis diagram for convolutional codes which is known 
in the art; 

[0043] Fig. 2 is a schematic illustration of a decoder, in accordance with a preferred 
embodiment of the present invention; 

[0044] Figs. 3 A and 3B are a flow chart of the actions performed in decoding 
received data symbols, in accordance with a preferred embodiment of the present 
invention; 

[0045] Fig. 4 is a schematic illustration of SM vectors of a decoded sub-block, in 
accordance with a preferred embodiment of the present invention; 
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[0046] Fig. 5 is a schematic illustration of SM vectors of a decoded sub-block, in 
accordance with another preferred embodiment of the present invention; and 
[0047] Fig. 6 is a schematic illustration of SM vectors of a large block, in accordance 
with a preferred embodiment of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
[0048] Fig. 2 is a schematic illustration of a decoder 20, in accordance with a 
preferred embodiment of the present invention. Decoder 20 preferably receives soft 
data symbols along an input channel 22. A buffer memory 24 accumulates a sufficient 
number of symbols in order to decode a sub-block. The received symbols are grouped 
into groups of one or more symbols according to the encoding scheme of the received 
data symbols. For each symbol group, an LLR unit 30, calculates an output value 
corresponding to the location of the symbol group in the sub-block. The calculation is 
preferably based on the values of substantially all the symbol groups in the sub-block, 
as is known in the art, and described, for example, in the above mentioned publication 
of Steven S. Pietrobon. In the following description the accumulated sub-block is 
assumed to comprise LI groups of symbols (Ri,...,Rli). In addition, buffer memory 
24 preferably accumulates L2 additional groups of symbols (Rli+1>"-3l1+L2) the 
purpose of which is described hereinbelow. 

[0049] As is known in the art, a branch metric (B M) calculation unit 25 calculates 
branch metrics (BMs) which represent the groups of symbols from buffer memory 24 
in the calculations. Alternatively, buffer memory 24 accumulates the BMs which were 
calculated by BM calculation unit 25. 

[0050] A forward calculation unit 26 and a backward calculation unit 28 calculate 
forward and backward state metric (SM) vectors, respectively, based on the 
accumulated symbols, as is known in the art. 

[005 1] LLR unit 30 uses the SM vectors from forward and backward calculation units 
26 and 28, together with the BMs from BM calculation unit 25, to provide the output 
values for each of the groups of symbols in the sub-block, using any method known in 
the art. The output provided by LLR unit 30 for each group of symbols, may comprise 
hard-data and/or soft-data values, may comprise a decoded value or may comprise an 
intermediate value used in additional decoding steps. 
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[0052] In order to calculate its output for each symbol group, LLR unit 30 receives 
the respective BM (5 n ) of the bit from buffer memory 24 and the SM vectors (a n , 

Pn+l) which correspond to the location of the symbol group within the sub-block, 

from both forward calculation unit 26 (oc n ) and backward calculation unit 28 O n +l)- 

The forward SM vectors (a n ) are calculated by forward calculation unit 26 

recursively from the beginning of the sub-block, based on a starting SM vector (oq) 

and the BMs (5i a ...,8 n «i). The starting SM vector (oq) is preferably determined either 

based on the SM vector from a previous sub-block or based on a predetermined value 
from which the decoding begins, e.g., a vector of zeros. Likewise, the backward SM 
vectors ((3 n ) are calculated by backward calculation unit 28 recursively from the end 

of the sub-block based on a last backward SM vector (Pli+i) °f the sub-block and 
the BMs (5 n +i,...,5Li). The ending backward SM vector (Pli+i) ls °^ a 
predetermined value or is calculated from the additional groups of symbols 
O^Ll+b ■■•3L1+L2) using any method known in the art, for example, that described 
in the above mentioned PCT publication WO98/20617. The number of additional 
groups of symbols L2 depends, as described in the above publication, on the size of 
the encoder and on the desired accuracy of the calculations. 

[0053] Backward calculation unit 28 preferably calculates the SM vectors in two 
stages. In a first preparation stage, performed before the beginning of the operation of 
LLR unit 30, backward calculation unit 28 calculates the backward SM vectors 
recursively and stores a plurality of them as reference vectors to be used in the second 
stage. The reference vectors are preferably stored in a long term storage 38 of an 
internal memory 34. In the second stage, a decoding stage, backward calculation unit 
28 preferably operates in parallel with LLR unit 30 and forward calculation unit 26 
and calculates the backward SM vector (P n ) presently needed by the LLR unit, based 

on the closest stored reference vector of a higher index (the backward vectors (P n ) are 

calculated from the highest index to the lowest index recursively, using methods 
known in the art). In a preferred embodiment of the invention, internal memory 34 
includes a short term storage area 36 in which the backward SM vectors between two 
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reference vectors are stored between their calculation and use during the decoding 
stage. This is a recalculation of values previously calculated and thrown away. 
[0054] A controller 32 controls the timing and operation of the units of decoder 20, in 
accordance with the following description. 

[0055] Figs. 3 [A and 3B are] is a flow chart of the actions performed in decoding 
received data symbols by decoder 20, in accordance with a preferred embodiment of 
the present invention. Buffer memory [Memory] 24 accumulates (block 50) symbols 
belonging to a sub-block of LI symbol groups. In addition, buffer memory 24 
preferably accumulates ( block 52) L2 additional symbol groups in order to calculate 
the last backward SM vector (PlI+0 of the sub-block. BM calculation unit 25 
preferably creates (block 54) respective representative BMs from the accumulated 
symbols, as is known in the art. 

[0056] Reference is also made to Fig. 4 which is a schematic illustration of the 
backward SM vectors ((3 n ) of the decoded sub-block, in accordance with a preferred 

embodiment of the present invention. In the preparation stage, backward calculation 
unit 28 calculates (block 57) backward SM vectors (p n ), using the representative BMs 
of the accumulated symbols of the sub block. Backward calculation unit 28 first 
determines (block 56) the last backward SM vector (PLl+l) 100 °f ^he sub block. 
Preferably, backward calculation unit 28 chooses an arbitrary SM vector as the value 
of Pl1+L2> f° r example a zero vector. Using the arbitrary vector and the L2 
additional symbol groups, backward calculation unit 28 calculates recursively the SM 
vectors PL2+L1 to PLl+1- The calculation is performed as is known in the art, for 
example as described in any of the above referenced application. With the calculation 
of each of the vectors, the previous vector is [preferably] discarded as these vectors do 
not carry reliable data and are not needed for further calculations. Vector Pli+i on 

the other hand is considered reliable as it is the result of L2 consecutive symbol group 
calculations and is [preferably] stored in long term storage 38, for later use. 
[0057] After backward SM vector PlI+1 * s calculated, backward calculation unit 28 
[preferably] continues to recursively calculate (block 58) the SM vectors Pl1> 

and periodically stores (block 62) some of the vectors 102 in long term storage 

12 



38, for later use. The reference vectors 102 to be stored are [preferably] chosen 
according to a predetermined scheme. In some preferred embodiments of the 
invention, the reference vectors are distributed throughout the sub block in equal 
intervals of SM vectors 104. In a preferred embodiment, illustrated by blocks 60, 61 
and 64, backward calculation unit 28 stores every i'th backward SM vector, i.e., 
PLl+l-mi (m=0...M=Ll/i) where i is close to the square root of LI, e.g., between 6 
and 10. In the following description it is assumed for simplicity that LI is divisible by 
i, and the stored backward reference vectors 102 are Pi+i, P2H-1> PLl+1- 
[0058] After the last backward vector 102 (Pi+i) to be stored in long term storage 38 

is calculated, the decoding stage [Q70[)] is performed. The decoding stage is 
[preferably] formed of a plurality of steps (M steps). In each step LLR unit 30 
provides output for i groups of symbols. Each of the steps, is [preferably] formed of 
two phases. In a first phase (block 66), backward calculation unit 28 [preferably] 
calculates the backward SM vectors (Pmi>...>P(m-l)iH-l) needed for that step, and 
stores them in short term storage 36. Backward calculation unit 28 [preferably] 
retrieves a reference vector (P m i) 102 from long term storage 38, and calculates 

therefrom, recursively, SM vectors (Pmi-l>...=.P(m-l)B-l)* 1x1 a preferred embodiment, 
also the retrieved reference vector (Pmi) is stored in short term storage 36. 
[0059] In the second phase ( block 71) of each step, forward calculation unit 26 
calculates ( block 68) the forward SM vectors (a n ) of that step, and forward and 
backward calculation units 26 and 28 provide (block 72) concurrently pairs of forward 
and backward SM vectors (a n , P n +l) to LLR unit 30. Preferably, backward 
calculation unit 28 provides the SM vectors by retrieving them from short term 
[memory] storage 36. LLR unit 30 immediately calculates ( block 74) its output 
responsive to the provided vectors and the relevant BM. 

[0060] Decoder 20 then [preferably] proceeds in decoding a following sub-block 
(returning to block 50), as is known in the art. It is noted that some of the operations 
in handling the following sub-block may be performed concurrently with the 
decoding stage 70 of the current sub-block. 
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[0061] The number of reference vectors stored in long term storage 38 is [preferably] 
chosen in a manner which minimizes the required size of internal memory 34. 
[Preferably,] The minimization is performed in a manner which does not increase the 
required computational resources of backward calculation unit 28 above a desired 
threshold. In a preferred embodiment of the invention, the number of reference 
vectors i stored in long term storage 38, is approximately equal to the square root of 
LI (the size of the decoded sub-block), as using the square root minimizes the size of 
memory 34. Thus, the long term storage 38 is of a size which accommodates i vectors 
and the size of short term storage 36 is, as well, one which accommodates i vectors. 
Thus, the total size of memory 34 is one which accommodates 2i SM vectors. 
[0062] Alternatively, long term storage 38 is larger, in order to reduce the amount of 
calculations required during the first phase (block 66) of the steps of the decoding 
stage. Further alternatively, the number of vectors 104 between each pair of reference 
vectors 102 is chosen in a manner which simplifies the implementation of backward 
calculation unit 28. In a preferred embodiment of the invention, the distance between 
consecutive reference vectors 102 is equal to 2 n , n being an integer. Thus, the 
hardware implementation of backward calculation unit 28 is simplified. 
[0063] Alternatively to having the same number of SM vectors 104 between the 
stored reference vectors 102, the number of vectors 104 between the stored reference 
vectors 102 differ throughout the sub-block. In a preferred embodiment of the present 
invention, the number of vectors 104 between the stored reference vectors 102 
increases with the indexes n of the symbol groups of the sub-block, i.e., the number of 
vectors 104 decreases with the progression of the backward calculation from the end 
of the sub-block to the beginning. During the first step of the decoding stage, long 
term storage 38 is full with SM vectors required at later steps of the decoding stage 
and therefore short term storage 36 must be used to store all the SM vectors calculated 
during the first phase ( block 66) of the first step of the decoding stage. At later steps, 
however, the number of spaces in long term storage 38 which are used decreases and 
the vacant spaces are [preferably] used for storing some of the vectors calculated 
during the first phase (block 66) of later steps of the decoding stage. In this 
embodiment, the border between long term storage 38 and short term storage 36 
moves with the steps of the decoding stage [(]70[)]. 

\ 
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[0064] For example, in a preferred embodiment of the invention, the size LI of the 
sub-block is 100, and vectors Pio> P20> 33b P43> P56> P70> P85> and PlOl are stored 
in long term storage 38 during the preparation stage ( block 57). In the first phase 
( block 66) of the first step of the decoding stage, backward calculation unit 28 
calculates eight vectors, i.e., P2, ... , Pg, which are stored in short term storage 36. In 
the first phase of the second step of the decoding stage, backward calculation unit 28 
calculates nine vectors, i.e., Pu, ... , Pig, P19. Eight of the vectors, e.g., Pu, ... , pjg, 

are stored in short term storage 36, and the ninth vector, e.g., Pi 9, is stored in long 

term storage 38 in place of vector Piq which is not needed anymore. In each 

following step, the number of vectors calculated in the first phase (block 66) increases 
by one, and the additional vector is stored in long term storage 38 in the places of the 
vectors which are not needed anymore. Thus, the number of spaces required for 
storing vectors in memory 34 is equal to 17, relative to 19 required spaces for evenly 
spaced reference vectors. 

[0065] For some decoding methods, such as for the log-map method, a function f 
used in calculating backward SM vector (P n ) from (P n +l) is a reversible function, 

such that a reverse function f" 1 may be used to calculate (P n +i) from (P n ). In some 

preferred embodiments of the present invention, the reverse function f*l is used to 
calculate the backward SM vectors (P n ) from the reference vectors during the 
decoding stage [(]70[)]. 

[0066] In a preferred embodiment of the present invention, the first backward SM 
vector of the sub-block (P2) is calculated during the preparation stage ( block 57). 

During the decoding stage, backward calculation unit 28 calculates vector (P n +l) 
from (P n ) using f~l, concurrently with the calculation of (a n ) from (a n .j) by forward 

calculation unit 26. [Preferably, in] In this embodiment memory 34 comprises only 
long term storage 38, and the first phase ( block 66) of the decoding stage [(]70[)], 
which is time consuming, is eliminated. 

[0067] In a preferred embodiment of the present invention, backward calculation unit 
28 does not include an internal memory 34. Rather, during the preparation stage 
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(block 57) backward calculation unit 28 calculates the first backward SM vector (P2) 

and uses the reverse function f"* to calculate all the backward SM vectors from 32, 
during the decoding stage [Q 70[)]. 

[0068] It is noted, however, that in some cases f - * introduces inaccuracies in the 
calculations due to round off problems of reverse functions. Therefore, as described 
above, in some preferred embodiments, reference vectors are stored in long term 
storage 38 during the preparation stage ( block 57), and the reverse function f" 1 is used 
only between the reference vectors. [Preferably, the] The distance between the 
reference vectors is set based on a maximal number of allowed consecutive reverse- 
function iterations R. The maximal number of reverse iterations R is [preferably] 

determined so that the round off error due to the use of the reverse function f _1 is 
limited below a desired level 

[0069] Fig. 5 is a schematic illustration of the SM vectors (P n ) of the decoded sub- 
block, in accordance with a preferred embodiment of the present invention. In some 
preferred embodiments of the present invention, only some of the backward SM 
vectors ((3 n ) are calculated using the reverse function f* 1 during the decoding stage 
[Q 70 D]- The rest of the backward SM vectors (P n ) are [preferably] calculated during 
the first phase (block 66) of the decoding stage [Q70[)] using the forward function f, 
as described above. For example, for each group of SM vectors 104, the first R 
vectors 107, which have lower indexes are calculated using f -1 . The rest of the 
vectors, i.e., vectors 109, are [preferably] calculated from the nearest reference vector 
102 using function f, as described above. Stated otherwise, in each step of the 
decoding stage [(]70[)] backward calculation unit 28 retrieves a reference vector 102 
from long term storage 38. Using function f, vectors 109 are calculated and stored in 
short term storage 36, during the first phase ( block 66). Thereafter, the same reference 
vector 102 is used with the reverse function f' 1 to calculate SM vectors 107. 
[0070] In a preferred embodiment, the distance between the reference vectors is 
determined using any of the considerations described above and based on the maximal 
number of allowed consecutive reverse iterations R. Designating the number of 
vectors which may be stored in short term storage 36 by SI, the number of vectors 
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between two neighboring reference vectors 102 is Sl+R. The number of reference 
vectors is S2=L1/(S1+R) and it is desired to minimize the space required in memory 
34, i.e., S1+S2. 

[0071] In some preferred embodiments of the present invention, function f is a non- 
reversible function f\ which is an approximation of a reversible function f2, e.g., due 

to round off or when using the log-max method which is an approximation of the log- 
map method. In one of these embodiments, some or all of the calculations which are 
performed using f, are performed with f=f\ 9 the non-reversible function. Calculations 

performed with the reverse function f-1 and possibly some of the calculations 
performed using f, are performed with f2 (f^"*)- 

[0072] Following is a showing of the reverse function f"* for exemplary functions f. 
Generating the reverse function equations for any other code will be obvious to those 
skilled in the art. 

In the 7.5 code described hereinabove with reference to fig. 1A, using the 
linear MAP method, function f is defined by the equation set: 



o00 oil 
oil oOO 



Pn+l 



and 



A 10 

A" J 



r!0 



'n 

,4 



jfil clO 



nOl 

Mj+1 
_Mi+l_ 



(1) 



The reverse function f~* is therefore defined by the following equations: 
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[0073] In some preferred embodiments of the present invention, when it is determined 
during calculation of a vector (3 n from (3 n +i in preparation stage ( block 57) that the 

branch metrics 5 n form a non-reversible (singular) function, one or more of the 
branch metrics 5 n are slightly changed in order to remove the singularity. For 
example, referring to equations (1), when for a specific n, the matrix in either of 
equations (1) is singular, i.e., 5 n ^=5 n ^ or 5 n 01 =5 n 10 5 a value Is for a small e is 

added to the matrix. That is, a value e is added to 5 n ^^ or 5 n ^ as required. 

Alternatively, a value e is added to 5 n ^l or 5 n ^ as required in order to remove the 
singularity. 
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[0074] Alternatively or additionally, when the function for calculating vector (3 n from 
vector P n +i is singular, [calculating] backward calculation unit 28 stores P n +1 suc ^ 

that it is not necessary to use the reverse of the singular matrix. [Preferably, memory] 
Memory 34 comprises a special storage area (not shown) for vectors stored due to 
singularities. Alternatively or additionally, at least some of the reference vectors 102 
are chosen based on the singularities. In a preferred embodiment of the present 
invention, backward calculation unit 28 stores reference vectors at equal intervals 
unless a singular equation is encountered in which case the vector on which the 
singular function is applied is stored and the equal vector intervals are [preferably] 
counted from that vector. In another preferred embodiment of the invention, the 
number of reference vectors 102 stored during the preparation stage (block 57) is 
constant and the intervals between reference vectors 102 when singularities are not 
encountered are adjusted according to the number of singularities encountered during 
the preparation stage. For example, preparation stage (block 57) may begin with 
storing each tenth vector. If a large number of singularities are encountered the 
interval between reference vectors is enlarged and, for example, every 15th vector is 
stored. If, however, less than an average number of singularities are encountered, the 
interval between stored vectors may be shortened. 

[0075] Alternatively to storing entire vectors P n +i to which singular functions are 
applied, a part of these vectors P n +1> including one or more elements, is stored. The 
one or more stored elements [preferably] allow calculation of the rest of the elements 
Pn+1 from P n despite the singularity of the function. 

[0076] Alternatively or additionally to storing vectors to which singular functions are 
applied, vectors which cannot be calculated using the reverse function f"l due to the 
singularity, are calculated during the first phase ( block 66) of the decoding stage [(] 
70[)] using function f [Preferably, for] For each interval between reference vectors 
102, the number of vectors 109 (Fig. 5) calculated using function f, and the number of 
vectors 107 calculated using function f*l, are dynamically adjusted according to 
whether the interval includes singular functions and where the singular function 
appears within the interval. 
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[0077] For the log MAP method, P n and 5 n have values which are the logarithms of 

their values in the linear case. Using the definitions in Fig. IB, the equations defining 
f for a pair of states x and y, are: 

= log(/" + e S " ) and $ = log(/" + ) . 

The reverse function f~l is [preferably] defined by the equations: 
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= iog( — — j 5 — r~) ^ 
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[0078] As LLR unit 30 is only interested in the relative values of the elements of 
backward vectors P n , equations (3) and (4) are [preferably] replaced by: 



#+l=log 



A+l = ^g 



+ C 



and 



(3') 



(4') 



[0079] [Preferably, for] For the log MAP method, functions f and f 1 are 
implemented partially or entirely using one or more look up tables (LUT). In a 
preferred embodiment of the invention, a LUT is used to approximate the function 
log(l+el x l) and log(l-eM). Singularities are [preferably] handled using any of the 
methods described above regarding the linear MAP method. 

[0080] The number LI of symbol groups in each sub-block used in decoding is 
[preferably] chosen as a compromise between the required amount of memory space 
and the decoding speed and accuracy. A conventional number of symbol groups LI 
used in the prior art is approximately 100. Although substantially any size LI of the 
sub-block may be used, in some preferred embodiments of the invention, the size LI 
of the sub-block is substantially larger than that conventionally used in the prior art. 
Using the methods of the present invention, the required size of memory 34 for a 
given size LI of the sub-block is significantly reduced relative to the prior art. 
Therefore it is possible to increase the size LI of the sub blocks, achieving faster and 
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better decoding, without substantially increasing the required size of memory 34. In a 
preferred embodiment of the invention, the decoding is performed on entire blocks, 
thus eliminating the need to accumulate ( block 52) the additional symbol groups and 
to calculate (block 56) Pli-H- Thus, the additional time required relative to the prior 

art for performing the first phase ( block 66) of the decoding stage, is partially 
compensated for. 

[0081] It is noted that the size LI of the sub-blocks used in decoding is not 
necessarily constant and LI may change during the decoding. 

The implementation of the present invention does not depend on the number 
of bits included in the state metrics in the forward and backward vectors, and 
substantially any number of bits may be used according to considerations known in 
the art. It is noted, however, that in some preferred embodiments of the present 
invention, the reduction in storage space achieved by the invention is used to increase 
the number of bits included in each state metric and thus increase the accuracy of 
decoder 20. 

[0082] Fig. 6 is a schematic illustration of the backward reference vectors (J3 n ) of a 

large block, in accordance with a preferred embodiment of the present invention. In 
some preferred embodiments of the invention, the preparation phase (block 66) 
comprises a plurality of sub phases, in order to further conserve memory space. 
[Preferably, instead] Instead of calculating and storing all the SM vectors 104 
between the reference vectors in one shot, requiring short term storage 36 to be of the 
size required to store all of vectors 104, backward calculation unit 28 calculates and 
stores the vectors 104 in a plurality of sub phases. For example, if the large block 
comprises a thousand symbol groups and the number of vectors 104 between the 
reference vectors 102 is one hundred, during the first sub phase backward calculation 
unit 28 may store every tenth vector 106. In a second sub-phase of preparation phase 
(block 66), backward calculation unit 28 calculates and stores all the vectors 108 
between vectors 106. Thus, for a large block of a thousand symbols, the required 
storage space in memory 34 comprises only room for about thirty vectors: ten vectors 
104 in long term storage 38, and ten vectors 106 and ten vectors 108 in short term 
storage 36. 
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[0083] It is noted that it is not necessary to store entire SM vectors in memory 34. For 
example, in some embodiments the different states of the SM vectors are related in a 
manner which allows calculating the entire vector (3 n from half of vector P n and a 

complementary half of vector P n +i- In such embodiments, it is possible to store in 

long term storage 38 complementary parts of consecutive vectors rather than entire 
vectors. 

[0084] For example, using as an example, the convolutional code 7.5 described above 
with reference to Fig. 1 A, rather than storing for each reference vector (3 n all the state 

metrics in the vector, backward calculation unit 28 stores the state metrics P n (01), 
0n( oo X Pn+l( 01 )> anc * Pn+1 0,1)- As can be seen from equations (1), P n (10) and 
0 n (ll) can be calculated from P n +j(01), and (3 n +i (11) and therefore storing the 
above state metrics is equivalent to storing vector (3 n (ignoring the additional 
calculations). 

[0085] In some preferred embodiments of the present invention, instead of storing all 
the elements of the reference vectors, only those elements of the vectors which are 
considered significant are stored, for some or all of the reference vectors. 
Alternatively or additionally, only some of the elements of the SM vectors stored 
during the decoding stage (in short term storage 36), are stored. The non-significant 
elements are [preferably] elements which have a state metric value much lower than 
other elements in the vector such that the chance of that element to be in a decoding 
trellis is very slight. 

[0086] It is noted that although the above description refers to forward decoding 
which requires pre-calculation of the backward SM vectors, the principles of the 
present invention apply equivalently to backward decoding in which the forward SM 
vectors are pre-calculated. Furthermore, although decoder 20 was shown as 
including only a single backward calculation unit 28, more than one unit may be used 
in parallel in order to speed up the operation of the decoder. In a preferred 
embodiment of the invention, backward calculation unit 28 comprises two sub-units 
which operate in parallel during the decoding stage. [Preferably, while] While a first 
sub-unit performs the second phase (71) of a current step, a second sub-unit performs 
the first phase ( block 66) of a next step. [Preferably, in] In this embodiment, memory 
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34 includes two short term storage spaces 36 which are used by the two sub-units 
interchangeably. 

[0087] It is further noted that the principles of the present invention apply 
substantially to any decoding method which implements the Bahl algorithm, and/or 
approximations of the Bahl algorithm, including the linear MAP version, the log MAP 
version, and the approximated log-max version. The principles of the present 
invention may be used with any finite state system, such as communication systems, 
and signal identification systems(e.g., handwriting, voice and image recognition). The 
communication systems may be used in decoding convolutional codes, trellis coded 
modulation (TCM) codes, BCH codes, or any other finite state codes. Alternatively or 
additionally, the principles of the present invention may be applied in performing 
channel equalization and/or in implementing an Inter symbol Interference (ISI) 
equalizer. 

[0088] It will be appreciated that the above described methods may be varied in many 
ways, including, changing the order of steps, and the exact implementation used. It 
should also be appreciated that the above described description of methods and 
apparatus are to be interpreted as including apparatus for carrying out the methods 
and methods of using the apparatus. 

[0089] The present invention has been described using non-limiting detailed 
descriptions of preferred embodiments thereof that are provided by way of example 
and are not intended to limit the scope of the invention. Variations of embodiments 
described will occur to persons of the art. Furthermore, the terms "comprise," 
"include," "have" and their conjugates, shall mean, when used in the claims, 
"including but not necessarily limited to." The scope of the invention is limited only 
by the following claims: 
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ABSTRACT 



[0090] A method of calculating recursive state metric vectors of a block of symbols 
wherein , the state metric vectors being supplied to an output calculating unit. The 
method includes [pre-] calculating the state metric vectors from a first side of the 
block, and calculating for a second time at least some of the state metric vectors from 
the first side of the block. 
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